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(54) Method and apparatus for inserting and extracting watermark into and from contents 
information 



(57) In a method of inserting watermark information 
into digital data, a specified data value is determined in 
response to the watermark information. A data-value 
occurrence-frequency distribution of a predetermined 
number of samples of the digital data is changed into a 



modified occurrence-frequency distribution in which the 
specified data value occurs at a frequency extremely 
different from frequencies of occurrence of data values 
other than the specified data value. 
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Description 

BACKGROUND OF THE INVEf^TION 

Field of the Invention 5 

[0001] This invention relates to a method and an 
apparatus for inserting a watermark into contents infor- 
mation. In addition, this invention relates to a method 
and an apparatus for extracting a watermark from 10 
watermarked contents information. 

Description of the Related Art 

[0002] U.S. Patent No. 5,930,369 (corresponding to is 
Japanese published unexamined patent application 9- 
191394) discloses digital watermarking of audio, image, 
video or multimedia data which is achieved by Inserting 
the watermark into the perceptually significant compo- 
nents of a decomposition of the data in a manner so as 20 
to be visually imperceptible. Specifically, U.S. Patent No. 
5,930,369 discloses a method in which a frequency 
spectral image of the data, preferably a Fourier trans- 
form of the data, is obtained, and a watermark is 
inserted into perceptually significant components of the 25 
frequency spectral image. The resultant watermarked 
spectral image is subjected to an inverse transform to 
produce watermarked data. The watermark is extracted 
form watermarked data by first comparing the water- 
marked data with the original data to obtain an extracted 30 
watermark. Then, the original watermark, original data 
and the extracted watermark are compared to generate 
a watermark which is analyzed for authenticity of the 
watermark. 

[0003] In U.S. Patent No. 5,930,369, the Fourier 35 
transform and the inverse transform cause a reduction 
in the cost performance ratio of the method. 
[0004] H. Ogawa et al., "A Copying Information 
Embedding Method using DCT for Digital Movies', in 
SCIS'97-31G, have reported watermarking methods ao 
which are suitable for MPEG bit streams. The methods 
are based on modifying DCT coefficients, motion vec- 
tors, and quantizer matrices. 

[0005] It is assumed that data which have been 
watermarked by one of the methods reported by H. 45 
Ogawa et al. are subjected to affine transformation to 
slightly rotate or distort a picture. It tends to be difficult 
to accurately extract the watermark from the transfor- 
mation-resultant watermarked data. 
[0006] International patent application WO so 
•89/08915 discloses a method of inserting an identifica- 
tion string into a digital audio signal by substituting the 
"insignificant" bits of randomly selected audio samples 
with the bits of an identification code. The method in 
application WO 89/08915 can also be applied to coding 55 
schemes which do not have a defined word structure, 
such as delta modulation, in which case digits can be 
replaced completely randomly without regard to relative 



significance. 

[0007] In the case of access to a portion of a digital 
audio signal into which an identification string has been 
inserted by the method in application WO 89/08915, it is 
difficult to recover (reproduce) the whole of the identifi- 
cation string if at least part of the identification string is 
in another portion of the digital audio signal. 

SUMMARY OF THE INVENTION 

[0008] It is a first object of this invention to provide 
an improved method of inserting a watermark into con- 
tents information. 

[0009] It is a second object of this invention to pro- 
vide an improved apparatus for inserting a watermark 
into contents information. 

[0010] It is a third object of this invention to provide 
an improved method of extracting a watermark from 
watermarked contents information. 
[001 1 ] It is a fourth object of this invention to provide 
an improved apparatus for extracting a watermark from 
watermarked contents information. 
[0012] A first aspect of this invention provides a 
method of inserting watermark information into digital 
data. The method comprises the steps of determining a 
specified data value in response to the watermark infor- 
mation; and changing a data-value occurrence-fre- 
quency distribution of a predetermined number of 
samples of the digital data into a modified occurrence- 
frequency distribution in which the specified data value 
occurs at a frequency extremely different from frequen- 
cies of occurrence of data values other than the speci- 
fied data value. 

[001 3] A second aspect of this invention provides a 
method of inserting watermark information into digital 
data. The method comprises the steps of calculating dif- 
ferences between samples of the digital data to gener- 
ate difference data representing the calculated 
differences; determining a specified difference data 
value in response to the watermark Information; and 
changing a data-value occurrence-frequency distribu- 
tion of a predetermined number of samples of the differ- 
ence data into a modified occurrence-frequency 
distribution In which the specified difference data value 
occurs at a frequency extremely different from frequen- 
cies of occurrence of difference data values other than 
the specified difference data value. 
[0014] A third aspect of this invention provides a 
method of inserting watermark information into digital 
data. The method comprises the steps of calculating dif- 
ferences between samples of the digital data to gener- 
ate difference data representing the calculated 
differences; determining a specified difference data 
value in response to the watermark information; and 
changing a normalized data-value occurrence-fre- 
quency Laplace distribution of a predetermined number 
of samples of the difference data into a modified occur- 
rence-frequency distribution in which the specified d'rf- 
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ference data value occurs at a frequency extremely 
different from frequencies of occurrence of difference 
data values other than the specified difference data 
value. 

[0015] A fourth aspect of this invention provides a 
method of extracting watermark information from digital 
data. The method comprises the steps of detecting an 
occurrence-frequency distribution of data values in a 
predetermined number of samples of the digital data; 
detecting, from the detected occurrence-frequency dis- 
tribution, a data value which occurs at a frequency 
extremely different from frequencies of occurrence of 
other data values; and reproducing the watermark infor- 
mation on the basis of the detected data value. 
[0016] A fifth aspect of this invention provides a 
method of extracting watermark information from digital 
data. The method comprises the steps of calculating dif- 
ferences between samples of the digital data to gener- 
ate difference data representing the calculated 
differences; detecting an occurrence-frequency distri- 
bution of difference data values in a predetermined 
number of samples of the difference data; detecting, 
from the detected occurrence-frequency distribution, a 
difference data value which occurs at a frequency 
extremely different from frequencies of occurrence of 
other difference data values; and reproducing the water- 
mark information on the basis of the detected difference 
data value. 

[0017] A sixth aspect of this invention provides a 
method of extracting watermark information from digital 
data. The method comprises the steps of calculating dif- 
ferences between samples of the digital data to gener- 
ate difference data representing the calculated 
differences; detecting a normalized occurrence-fre- 
quency Laplace distribution of difference data values in 
a predetermined number of samples of the difference 
data; detecting, from the detected normalized occur- 
rence-frequency Laplace distribution, a difference data 
value which occurs at a frequency extremely different 
from frequencies of occurrence of other difference data 
values; and reproducing the watermark information on 
the basis of the detected difference data value. 
[0018] A seventh aspect of. this invention provides 
an apparatus for inserting watermark information into 
digital data The apparatus comprises means for deter- 
mining a specified data value in response to the water- 
mark information; and means for changing a data-value 
occurrence-frequency distribution of a predetermined 
number of samples of the digital data into a modified 
occurrence-frequency distribution in which the specified 
data value occurs at a frequency extremely different 
from frequencies of occurrence of data values other 
than the specified data value. 

[0019] An eighth aspect of this invention provides 
an apparatus for inserting watermark information into 
digital data. The apparatus comprises means for calcu- 
lating differences between samples of the digital data to 
generate difference data representing the calculated 



differences; means for determining a specified differ- 
ence data value in response to the watermark informa- 
tion; and means for changing a data-value occurrence- 
frequency distribution of a predetermined number of 

5 samples of the difference data into a modified occur- 
rence-frequency distribution In which the specified dif- 
ference data value occurs at a frequency extremely 
different from frequencies of occurrence of difference 
data values other than the specified difference data 

10 value. 

[0020] A ninth aspect of this invention provides an 
apparatus for inserting watermark information into dig- 
ital data. The apparatus comprises means for calculat- 
ing differences between samples of the digital data to 

is generate difference data representing the calculated 
differences; means for determining a specified differ- 
ence data value in response to the watermark informa- 
tion; and means for changing a normalized data-value 
occurrence-frequency Laplace distribution of a prede- 

20 termined number of samples of the difference data into 
a modified occurrence-frequency distribution, in which 
the specified difference data value occurs at a fre- 
quency extremely different from frequencies of occur- 
rence of difference data values other than the specified 

25 difference data value. 

[0021] A tenth aspect of this invention provides an 
apparatus for extracting watermark information from 
digital data. The apparatus comprises means for detect- 
ing an occurrence-frequency distribution of data values 

30 In a predetermined number of samples of the digital 
data; means for detecting, from the detected occur- 
rence-frequency distribution, a data value which occurs 
at a frequency extremely different from frequencies of 
occurrence of other data values; and means for repro- 

35 ducing the watermark information on the basis of the 
detected data value. 

[0022] An eleventh aspect of this invention provides 
an apparatus for extracting watermark information from 
digital data. The apparatus comprises means for calcu- 

40 lating differences between samples of the digital data to 
generate difference data representing the calculated 
differences; means for detecting an occurrence-fre- 
quency distribution of difference data values in a prede- 
termined number of samples of the difference data; 

45 means for detecting, from the detected occurrence-fre- 
quency distribution, a difference data value which 
occurs at a frequency extremely different from frequen- 
cies of occurrence of other difference data values; and 
means for reproducing the watermark information on 

so the basis of the detected difference data value. 

[0023] A twelfth aspect of this invention provides an 
apparatus for extracting watermark information from 
digital data. The apparatus comprises means for calcu- 
lating differences between samples of the digital data to 

55 generate difference data representing the calculated 
differences; means for detecting a normalized occur- 
rence-frequency Laplace distribution of difference data 
values in a predetermined number of samples of the dif- 
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fere nee data; means for detecting, from the detected 
normalized occurrence-frequency Laplace distribution, 
a difference data value which occurs at a frequency 
extremely different from frequencies of occurrence of 
other difference data values; and means for reproducing 
the watermark information on the basis of the detected 
difference data value. 

[0024] A thirteenth aspect of this invention provides 
an apparatus for inserting watermark information into 
digital data. The apparatus comprises means for deriv- 
ing differences between samples of the digital data; 
means for selecting at least one from among values, 
which differences between samples of the digital data 
can take, as a forbidden value in response to the water- 
mark information; means for deciding whether or not the 
derived differences are equal to the forbidden value; 
and means for changing logic states of samples of the 
digital data which relate to the derived differences 
decided to be equal to the forbidden value to convert the 
digital data into conversion- resultant data to inhibit dif- 
ferences between samples of the conversion-resultant 
data from taking the forbidden value. 
[0025] A fourteenth aspect of this invention pro- 
vides an apparatus for extracting watermark information 
from digital data. The apparatus comprises means for 
deriving differences between samples of the digital 
data; means for detecting an occurrence-frequency dis- 
tribution of values of the derived differences; means for 
comparing the detected occurrence-frequency distribu- 
tion with a predetermined reference occurrence-fre- 
quency distribution to find a difference value whose 
detected occurrence frequency is smaller than its refer- 
ence occurrence frequency by more than a given per- 
centage; and means for reproducing the watermark 
information on the basis of the found difference value. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] 

Fig. 1 is a block diagram of a watermark embedding 

apparatus (a watermark inserting apparatus) 

according to a first embodiment of this invention. 

Fig. 2 is a flow diagram of operation of a digital 

processing device in Fig. 1 . 

Fig. 3 is a diagram of pixel areas in a frame. 

Fig. 4 is a diagram of an example of the values of 

adjacent pixels forming a left-upper corner of a 

frame. 

Fig. 5 is a diagram of the values of adjacent pixels 
which result from processing of the pixels in Fig. 4 
according to the operation flow in Rg. 2. 
Fig. 6 is a block diagram of a watermark extracting 
apparatus according to a second embodiment of 
this invention. 

Fig. 7 is a flow diagram of operation of a digital 

processing device in Rg. 6. 

Fig. 8 is a block diagram of a watermark embedding 



apparatus (a watermark inserting apparatus) 
according to a third embodiment of this invention. 
Rg. 9 is a time-domain diagram of an example of 
the levels represented by successive samples of 
5 original data 

Rg. 10 is a diagram of the structure of picture data 
for one frame. 

Rg. 1 1 is a diagram of an occurrence-frequency 
distribution of the values of the differences between 
io data samples. 

Rg. 1 2 is a block diagram of a watermark extracting 
apparatus according to a fourth embodiment of this 
invention. 

Rg. 13 is a diagram of an example of the occur- 
is rence-frequency distribution of sample values. 

Rg. 14 is a time-domain diagram of an example of 
the levels represented by successive data samples. 
Rg. 1 5 is a diagram of a frame, and zones cut out 
therefrom. 

20 

DESCRIPTION OF THE PREFERRED EMBODI- 
M ENT S 

Rrst Embodiment 

25 

[0027] Rg. 1 shows a watermark embedding appa- 
ratus (a watermark inserting apparatus) according to a 
first embodiment of this invention. The apparatus in Fig. 
1 includes a digital processing device 40 such as a sig- 

30 naJ processor or a computer. The digital processing 
device 40 has a combination of an input/output (I/O) 
port 40A, a processing unit 40B, a RAM 40C, and a 
ROM 40D. The digital processing device 40 operates in 
accordance with a program stored in the ROM 40D. The 

35 digital processing device 40 receives, via the I/O port 
40A, input contents data (data representing contents 
information or main information) and a signal represent- 
ing a digital watermark. The digital processing device 40 
generates watermarked contents data or watermark- 

40 embedded contents data in response to the input con- 
tents data and the watermark signal. The digital 
processing device 40 outputs the watermark-embedded 
contents data via the I/O port 40A. 
[0028] The input contents: data are picture data 

45 such as luminance data, color data, or color-difference 
data. The input contents data have a sequence of sam- 
ples corresponding pixels respectively. Each of the 
samples has a predetermined number of bits, for exam- 
ple, 8 bits. The watermark signal has a predetermined 

so number of bits, for example, 3 bits. 

[0029] Preferably, samples of the input contents 
data are separated into groups each having a predeter- 
mined number of samples, for example, 1024 samples. 
Preferably, the watermark signal is varied from sample 

55 group to sample group. 

[0030] Rg. 2 shows a flow of operation of the digital 
processing device 40 for every sample (every pixel) 
which is controlled by the program stored in the ROM 
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40D. With reference to Fig. 2, a block 50 determines for- 
bidden values on the basis of the watermark signal. 
Logic states (levels) of the watermark signal are previ- 
ously assigned to forbidden values. In the case where 
the watermark signal has 3 bits, first to eighth levels of 5 
the watermark signal are assigned to forbidden values 
■0", "±1", "±2", '±3", "±4", "±5\ "±6", and "±7". Specifi- 
cally, the first level of the watermark signal is assigned 
to the forbidden value "0". The second level of the 
watermark signal Is assigned to the forbidden values w 
"±1". The third level of the watermark signal is assigned 
to the forbidden values '±2'. The fourth level of the 
watermark signal is assigned to the forbidden values . 
"±3". The fifth level of the watermark signal is assigned 
to the forbidden values "±4". The sixth level of the water- 15 
mark signal is assigned to the forbidden values "±5". 
The seventh level of the watermark signal is assigned to 
the forbidden values "±6\ The eighth level of the water- 
mark signal is assigned to the forbidden values "±7\ A 
table indicating the assignment of the levels of the 20 
watermark signal to the forbidden values is provided in 
the ROM 40D. The block 50 determines the forbidden 
value or values by referring to the table in response to 
the watermark signal. After the block 50, the operation 
flow advances to a block 51 . 2 5 
[0031 ] Preferably, the watermark signal is designed 
to prevent the determined forbidden value or values 
from being equal to "0". In this case, the watermark sig- 
nal takes any one of the levels except the first level. . 
[0032] The block 51 accesses 9 samples of the 30 
input contents data which correspond to the pixel "e" of 
interest and 8 pixels "a", "b", "c", "d", "f , "g", "h", and T 
neighboring the pixel "e" of interest (see Fig. 3). The 
block 51 subtracts the value of the pixel "e" of interest 
from the value of the neighboring pixel "a", and hence 35 
calculates the pixel-value difference "a-e". The block 51 
subtracts the value of the pixel "e" of interest from the 
value of the neighboring pixel "b", and hence calculates 
the pixel-value difference "b-e". The block 51 subtracts 
the value of the pixel "e" of interest from the value of the 40 
neighboring pixel "c", and hence calculates the pixel- 
value difference "c-e". The block 51 subtracts the value 
of the pixel "e" of interest from the value of the neighbor- 
ing pixel "d", and hence calculates the pixel-value differ- 
ence "d-e". The block 51 subtracts the value of the pixel 45 
"e" of interest from the value of the neighboring pixel "f, 
and hence calculates the pixel-value difference "f-e". 
The block 51 subtracts the value of the pixel "e" of inter- 
est from the value of the neighboring pixel "g", and 
hence calculates the pixel-value difference "g-e". The so 
block 51 subtracts the value of the pixel "e" of interest 
from the value of the neighboring pixel "h", and hence 
calculates the pixel-value difference "h-e". The block 51 
subtracts the value of the pixel "e" of interest from the 
value of the neighboring pixel T, and hence calculates 55 
the pixel-value difference "i-e\ 

[0033] A block 52 following the block 51 decides 
whether or not at least one of the calculated pixel-value 



differences "a-e", 'b-e', "c-e\ "d-e', "f-e", "g-e', -h-e", 
and "i-e" is equal to one of the determined forbidden val- 
ues. When at least one of the calculated pixel-value dif- 
ferences is equal to one of the determined forbidden 
values, the operation flow advances from the block 52 to 
a block 53. Otherwise, the operation flow ends. In this 
case, the sample of the input contents data which corre- 
sponds to the pixel "e" of interest is maintained as it is 
without being processed. 

[0034] The block 53 increments the value of the 
pixel "e" of interest by "1 Specifically, the block 53 
increments the value represented by the sample of the 
input contents data which corresponds to the pixel "e" of 
interest. 

[0035] A block 54 subsequent to the block 53 is sim- 
ilar to the block 51. The block 54 calculates the pixel- 
value differences "a-e", "b-e", "c-e", "d-e", 'f-e', "g-e", 
"h-e", and "i-e". 

[0036] A block 55 following the block 54 is similar to 
the block 52. The block 55 decides whether or not at 
least one of the calculated pixel-value differences "a-e", 
"b-e", "c-e", "d-e", "f-e", "g-e", "h-e", and "i-e" is equal to 
one of the determined forbidden values. When at least 
one of the calculated pixel-value differences is equal to 
one of the determined forbidden values, the operation 
flow returns from the block 55 to the block 53. Other- 
wise, the operation flow advances from the block 55 to a 
block 56. 

[0037] Accordingly, the value of the pixel "e" of inter- 
est continues to be periodically incremented until all the 
calculated pixel-value differences "a-e", "b-e", "c-e", "d- 
e", ^-e", "g-e", "h-e", and "i-e" become different from the 
determined forbidden values. 

[0038] The block 56 defines the value (the current 
value) of the pixel "e" of interest as an increment-side 
value. 

[0039] A block 57 subsequent to the block 56 
returns the value of the pixel "e" of interest to the origi- 
nal one. Specifically, the block 57 returns the value rep- 
resented by the sample of the input contents data which 
corresponds to the pixel "e" of interest. Alter the block 
57, the operation flow advances to a block 58. 
[0040] The block 58 decrements the value of the 
pixel "e" of interest by "1". Specifically, the block 58 dec- 
rements the value represented by the sample of the 
input contents data which corresponds to the pixel "e" of 
interest. 

[0041] A block 59 subsequent to the block 58 is sim- 
ilar to the block 51. The block 59 calculates the pixel- 
value differences "a-e", "b-e", "c-e", "d-e", "f-e", "g-e", 
"h-e", and "i-e". 

[0042] A block 60 following the block 59 is similar to 
the block 52. The block 60 decides whether or not at 
least one of the calculated pixel-value differences "a-e", 
"b-e", "c-e", "d-e", "f-e", "g-e", "h-e", and "i-e" is equal to 
one of the determined forbidden values. When at least 
one of the calculated pixel-value differences is equal to 
one of the determined forbidden values, the operation 
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flow returns from the block 60 to the block 58. Other- 
wise, the operation flow advances from the block 60 to a 
block 61. 

[0043] Accordingly, the value of the pixel "e" of inter- 
est continues to be periodically decremented until all the s 
calculated pixel-value differences "a-e", "b-e", "c-e", "d- 
e", f -e\ "g-e", "h-e", and "i-e" become different from the 
determined forbidden values. 

[0044] The block 61 defines the value (the current 
value) of the pixel "e" of interest as a decrement-side w 
value. 

[0045] A block 62 subsequent to the block 61 
selects one of the increment-side value and the decre- 
ment-side value. The block 62 sets the value of the pixel 
"e" of interest to the selected value. Specifically, the is 
block 62 decides which of the increment-side value and 
the decrement-side value is closer to the original value 
of the pixel "e" of interest The block 62 selects one of 
the increment-side value and the decrement-side value 
which is decided to be closer to the original value of the 20 
pixel "e" of interest When the increment-side value and 
the decrement-side value are equidistant from the origi- 
nal value of the pixel "e" of interest, the block 62 selects 
the decrement-side value. After the block 62, the opera- 
tion flow ends. 25 
[0046] In this way, every sample of the input con- 
tents data is processed according to the flow operation 
in Fig. 2. A sample to be processed Is shifted from one 
to another in a predetermined scanning direction on a 
raster. A sample of the input contents data which has 30 
been processed according to the flow operation in Fig. 2 
forms a sample of the watermark-embedded contents 
data (the watermarked contents data). 
[0047] Regarding the watermark-embedded con- 
tents data, the differences between the values of neigh- 35 
boring pixels hardly take the forbidden values 
determined in accordance with the watermark signal. 
Thus, a pixel-value difference equal to one of the deter- 
mined forbidden values occurs at a very low frequency. 
On the other hand, pixel-value differences different from 40 
the determined forbidden values occur at frequencies 
remarkably higher than the frequency of the occurrence 
of the pixel-value difference equal to one of the deter- 
mined forbidden values. Since the determined forbidden 
values depend on the watermark signal, a pixel-value 45 
difference equal to one of the determined forbidden val- 
ues can be used as an indication of the watermark sig- 
nal. In other words, the pixel-value difference equal to 
one of the determined forbidden values indicates the 
watermark signal embedded in the contents data, so 
Accordingly, the watermark signal can be reproduced or 
recovered from the watermark-embedded contents data 
by searching pixel-value differences for a pixel-value dif- 
ference which occurs at a very low frequency. 
[0048] Fig. 4 shows an example of the values of 55 
adjacent pixels forming a I eft- upper corner of a frame. 
The left-upper pixel is assumed to be a pixel "e" of inter- 
est In Fig. 4, the value of the pixel "e" of interest is equal 



to '20". The values of pixels T, "h", and V neighboring 
the pixel "e" of interest are equal to '21', '21', and "20" 
respectively. In this case, the pixel-value differences "f- 
e", "h-e", and 'i-e' calculated by the block 51 in Fig. 2 
are equal to VI", "+1", and "0" respectively. 
[0049] It is assumed that the determined forbidden 
values are equal to "±1 ". In this case, the block 52 in Fig. 
2 decides that at least one of the pixel-value differences 
"f-e", "h-e", and "i-e" is equal to one of the determined 
forbidden values (±1). Therefore, the block 53 in Fig. 2 
increments the value of the pixel "e" of interest from "20" 
to "21". Subsequently, the block 54 in Fig. 2 calculates 
the pixel-value differences "f-e", "h-e", and "i-e" which 
are equal to '0', "0", and '-1' respectively. Thus, the 
block 55 in Fig. 2 decides that at least one of the pixel- 
value differences "f-e", 'h-e", and "i-e" is equal to one of 
the determined forbidden values (±1). Therefore, the 
block 53 in Fig. 2 increments the value of the pixel "e" of 
interest from '21' to "22". Subsequently, the block 54 in 
Fig. 2 calculates the pixel-value differences 'f-e", •h-e", 
and "i-e" which are equal to "-1", "-1", and "-2" respec- 
tively. Thus, the block 55 in Fig. 2 decides that at least 
one of the pixel-value differences "f-e", "h-e", and "i-e" is 
equal to one of the determined forbidden values (± 1). 
Therefore, the block 53 in Fig. 2 increments the value of 
the pixel "e" of interest from "22" to "23". Subsequently, 
the block 54 in Fig. 2 calculates the pixel-value differ- 
ences "f-e", "h-e", and "i-e" which are equal to "-2", "-2", 
and "-3" respectively. Thus, the block 55 in Fig. 2 
decides that all the pixel-value differences "f-e", "h-e", 
and "i-e" are different from the determined forbidden 
values (±1). In this case, the block 56 in Fig. 2 defines 
the value "23" of the pixel "e" of interest as the incre- 
ment-side value. 

[0050] Subsequently, the block 57 in Fig. 2 returns 
the value of the pixel "e" of interest to the original one. 
Then, the block 58 in Fig. 2 decrements the value of the 
pixel "e" of interest from "20" to "1 9". Next, the block 59 
in Fig. 2 calculates the pixel-value differences "f-e", "h- 
eV and "i-e" which are equal to "+2", "+2", and VP 
respectively. Thus, the block 60 in Fig. 2 decides that at 
least one of the pixel-value differences "f-e", "h-e", and 
"i-e" is equal to one of the determined forbidden values 
(±1). Therefore, the block 58 in Fig. 2 decrements the 
value of the pixel "e" of interest from "19" to "18". Sub- 
sequently, the block 59 in Fig. 2 calculates the pixel- 
value differences "f-e", "h-e", and "i-e" which are equal 
to "+3", "+3", and "+2" respectively. Thus, the block 60 in 
Fig. 2 decides that all the pixel-value differences "f-e", 
"h-e", and "i-e" are different from the determined forbid- 
den values (±1). In this case, the block 61 in Fig. 2 
defines the value "18" of the pixel "e" of interest as the 
decrement-side value. 

[0051] Since the decrement-side value "18" is 
closer to the original value "20" of the pixel "e" of interest 
than the increment-side value "23" is, the block 62 
selects the decrement-side value "18". In addition, the 
block 62 sets the value of the pixel "e" of interest to the 
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selected value, that is, the decrement-side value "1 8". In 
this way, the value of the pixel "e" of interest is changed 
from "20' to 18". 

[0052] Ftg. 5 shows the values of adjacent pixels 
which result from processing of the pixels in Fig. 4 5 
according to the operation flow in Fig. 2. 
[0053] In some cases, the watermark-embedded 
contents data are subjected to a general compression 
process or a general low-pass filtering process. Even in 
these cases, the frequency of the occurrence of the w 
pixei-value difference equal to one of the determined 
forbidden values. Is still low enough to accurately 
recover (reproduce) the watermark signal. 

Second Embodiment is 

[0054] Fig. 6 shows a watermark extracting appara- 
tus according to a second embodiment of this invention. 
The apparatus in Fig. 6 includes a digital processing 
device 70 such as a signal processor or a computer. 20 
The digital processing device 70 has a combination of 
an input/output (I/O) port 70 A, a processing unit 70B, a 
RAM 70C, and a ROM 70D. The digital processing 
device 70 operates in accordance with a program stored 
in the ROM 70D. The digital processing device 70 25 
receives, via the I/O port 70A, watermark-embedded 
contents data (watermarked contents data) generated 
by the apparatus in Fig. 1 . The digital processing device 
70 extracts or recovers (reproduces) a watermark signal 
from the watermark-embedded contents data. The dig- 30 
ital processing device 70 outputs the extracted water- 
mark signal via the I/O port 70A. 
[0055] The watermark-embedded contents data 
are picture data such as luminance data, color data, or 
color-difference data The watermark-embedded con- 35 
tents data have a sequence of samples corresponding 
pixels respectively. Each of the samples has a predeter-. 
mined number of bits, for example, 8 bits. The water- 
mark signal has a predetermined number of bits, for 
example, 3 bits. 40 
[0056] Samples of the watermark-embedded con- 
tents data are separated into groups each having a pre- 
determined number of samples, for example, 1024 
samples. The watermark signal is varied from sample 
group to sample group. 45 
[0057] Fig. 7 shows a flow of operation of the digital 
processing device 70 for every sample group which is 
controlled by the program stored in the ROM 70D. With 
reference to Rg. 7, a block 80 accesses a group of sam- 
ples of the watermark-embedded contents data which so 
correspond to pixels forming at least a part of a frame. 
The number of samples in the group is equal to, for 
example, 1024. The bock 80 calculates the differences 
between the values of neighboring pixels. 
[0058] A block 81 following the block 80 calculates a 55 
normalized occurrence-frequency distribution of the cal- 
culated pixel-value differences. The calculated occur- 
rence-frequency distribution is referred to as the 



detected occurrence-frequency distribution. 
[0059] A block 82 subsequent to the block 81 
retrieves a predetermined reference occurrence-fre- 
quency distribution of pixel-value differences. Specifi- 
cally, information representing a typical occurrence- 
frequency distribution of pixel-value differences is 
stored In the ROM 70D. The typical occurrence-fre- 
quency distribution is, for example, an occurrence-fre- 
quency Laplace distribution. The typical occurrence- 
frequency distribution is referred to as the reference 
occurrence-frequency distribution. The block 82 reads 
the information of the reference occurrence-frequency 
distribution from the ROM 70D. 

[0060] A block 83 following the block 82 compares 
the detected occurrence-frequency distribution and the 
reference occurrence-frequency distribution in a limited 
range of pixel-value differences which can be equal to a 
watermark-related forbidden value in a 0-containing 
positive side or a 0-containing negative side. In the case 
where a watermark signal has 3 bits, the limited range 
extends from "0" to m +T or from m -7 m to "0V The compar- 
ison by the block 83 is to find a pixel-value difference 
whose detected occurrence frequency is lower than its 
reference occurrence frequency by more than a given 
percentage. Specifically, for every pixel-value difference 
in the detected occurrence-frequency distribution and 
the reference occurrence-frequency distribution in the 
limited range, the block 83 derives the detected occur- 
rence frequency and the reference occurrence fre- 
quency from the detected occurrence-frequency 
distribution and the reference occurrence-frequency 
distribution respectively. Then, the block 83 compares 
the detected occurrence frequency and the reference 
occurrence frequency, and decides whether or not the 
detected occurrence frequency is lower than the refer- 
ence occurrence frequency by more than the given per- 
centage. The block 83 regards the found pixel-value 
difference as a detected forbidden value. 
[0061] A block 84 subsequent to the block 83 gen- 
erates a watermark signal in response to the detected 
forbidden value. Specifically, logic states (levels) of a 
watermark signal are previously assigned to forbidden 
values. In the case where the watermark signal has 3 
bits, first to eighth levels of the watermark signal are 
assigned to forbidden values "0", "±1", "±2", '±3', "±4 B , 
"±5-, "±6", and "±7". Specifically, the first level of the 
watermark signal is assigned to the forbidden value "0\ 
The second level of the watermark signal is assigned to 
the forbidden values "±1". The third level of the water- 
mark signal is assigned to the forbidden values '±2\ 
The fourth level of the watermark signal is assigned to 
the forbidden values "±3\ The fifth level of the water- 
mark signal is assigned to the forbidden values '±4'. 
The sixth level of the watermark signal is assigned to 
the forbidden values "±5". The seventh level of the 
watermark signal is assigned to the forbidden values 
■±6\ The eighth level of the watermark signal is 
assigned to the forbidden values "±7". A table indicating 
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the assignment of the levels of the watermark signal to 
the forbidden values is provided in the ROM 70D. The 
block 84 determines a watermark-signal level by refer- 
ring to the table in response to the detected forbidden 
value. The block 84 generates a watermark signal in 
accordance with the determined level. After the block 
84, the operation flow ends 

[0062] It is possible to accurately recover (repro- 
duce) the watermark signal from only a part of the 
watermark-embedded contents data. Even in the case 
where the watermark-embedded contents data are 
processed to slightly rotate or distort a picture before 
the contents data are inputted into the apparatus of Fig. 
6, the watermark signal can be accurately recovered 
from the inputted contents data. 

Third Embodiment 

[0063] Fig. 8 shows a watermark embedding appa- 
ratus (a watermark inserting apparatus) according to a 
third embodiment of this invention. The apparatus in 
Fig. 8 includes a difference-value detector 1 , a CPU 2, 
an Interval deciding device 3, a difference-value con- 
verter 4, and a characteristic-value converter 5. The dif- 
ference-value detector 1 is connected to the difference- 
value converter 4. The CPU 2 is connected to the inter- 
val deciding device 3. The interval deciding device 3 is 
connected to the difference-value detector 1 . The char- 
acteristic-value converter 5 is connected to the differ- 
ence-value converter 4. 

[0064] Original data are inputted into the difference- 
value detector 1 . The original data are picture data or 
audio data. The original data are formed by a sequence 
of samples. Preferably, samples of the original data are 
separated into groups each having 1 024 samples. 
[0065] In the case where the original data are audio 
data, the original data are formed by a sequence of 1 6- 
bit samples which result from sampling at a predeter- 
mined frequency. Fig. 9 shows an example of the levels 
represented by successive samples of the original data. 
[0066] In the case where the original data are pic- 
ture data, the original data are formed by a sequence of 
8-bit samples which represent a luminance signal Y of 
720 pixels in a horizontal direction and 480 lines in a 
vertical direction, and color difference signals Cb and Cr 
each of 360 pixels in a horizontal direction and 480 lines 
in a vertical direction for one frame as shown in Fig. 1 0. 
[0067] According to a first example, the difference- 
value detector 1 calculates the values of the differences 
between samples of the original data which are sepa- 
rated at a predetermined interval. 
[0068] According to a second example, the CPU 2 
gives a desired interval to the interval deciding device 3. 
The interval deciding device 3 decides, on the basis of 
the desired interval, an interval related to calculation by 
the difference-value detector 1. The Interval deciding 
device 3 informs the difference-value detector 1 of the 
decided interval. The difference-value detector 1 calcu- 



lates the values of the differences between samples of 
the original data which are separated at an interval 
equal to the decided interval. 

[0069] According to a third example, the difference- 
5 value detector 1 calculates the values of the differences 
between samples of the original data which are sepa- 
rated at an interval varied on the basis of a random- 
number table. The random-number table is possessed 
in common by the encoding side and the decoding side. 
w In this case, it is possible to provide a high security for 
watermark information. 

[0070] According to a fourth example, the differ- 
ence-value detector 1 calculates the values of the differ- 
ences between samples of the original data which are 
is separated at an interval changed in units of given sam- 
ple number or given time. 

[0071] The difference-value detector 1 informs the 
difference-value converter 4 of the calculated inter-sam- 
ple difference values. In addition, the difference-value 
20 detector 1 transmits the original data to the difference- 
value converter 4. 

[0072] Information representing a watermark to be 
embedded is inputted into the characteristic- value con- 
verter 5. The characteristic-value converter 5 changes 

25 the watermark information into a corresponding differ- 
ence value referred to as a forbidden difference value or 
a characteristic value. Specifically, different levels (dif- 
ferent logic states) of watermark information are previ- 
ously assigned to different difference values, 

30 respectively. According to this assignment, the charac- 
teristic-value converter 5 executes the change of the 
watermark information into the corresponding differ- 
ence value. The characteristic-value converter 5 
informs the difference-value converter 4 of the differ- 
as ence value (the watermark-related difference value, the 
forbidden difference value, or the characteristic value). 
[0073] In the case where samples of the original . 
data are separated into groups each having 1024 sam- 
ples, the watermark information is preferably varied 

40 from sample group to sample group. 

[0074] The difference-value converter 4 decides 
whether or not each of the inter-sample difference val- 
ues fed from the difference-value detector 1 is equal to 
the watermark-related difference value. When the inter- 

45 sample difference value is equal to the watermark- 
related difference value, the difference-value converter 
4 changes the inter-sample difference value to another 
value. Specifically, the difference-value converter 4 
increments or decrements the value of the related sam- 

50 pie of the original data by V. The inter-sample differ- 
ence value equal to the watermark-related difference 
value is referred to as the forbidden difference value. 
[0075] In this way, the forbidden difference value is 
changed to another value by the difference-value con- 

55 verter 4. The value conversion by the difference-value 
converter 4 causes the watermark information to be 
embedded into the original data. The difference-value 
converter 4 outputs the resultant watermark-embedded 



8 



15 



EP 1 069 757 A2 



16 



data. 

[0076] In the case of correlative data such as audio 
data or picture data in which adjacent samples tend to 
be resemblant to each other, the values of the differ- 
ences between samples troop toward "0" as shown in s 
Fig. 1 1 . The probability density function of the values of 
the differences between samples of actual audio data, 
or the probability density function of the values of the 
differences between horizontally-separated or verti- 
cally-separated samples of actual picture data corre- io 
sponds to a Laplace distribution *?' such as shown in 
Fig. 1 1 . The Laplace distribution "P" is expressed as fol- 
lows: 

P(d) = 1/(V2a) • exp(-V2ldl/o) (1) is 

where "d B denotes an inter-sample difference value, and 
m a m denotes the standard deviation. According to the 
Laplace distribution "P\ the probability density 
decreases exponentially as the inter-sample difference 20 
value "d B increases or decreases from B 0\ 
[0077] With reference to Fig. 1 1 , in the case where 
the inter-sample difference value m -2 m is inhibited from 
occurring in the Laplace distribution "P", that is, in the 
case where the forbidden difference value is set to "-2", 25 
the watermark information corresponding to the differ- 
ence value m -2" is embedded into the original data. 

Fourth Embodiment 

30 

[0078] Fig. 12 shows a watermark extracting appa- 
ratus according to a fourth embodiment of this inven- 
tion. The apparatus in Fig. 12 includes a difference 
value detector 1 1 , a CPU 1 2, an interval deciding device 
13, a distribution detector 14, a distribution comparator 35 
15, a characteristic-value detector 16, and a converter 
1 7. The difference-value detector 1 1 is connected to the 
distribution detector 14. The distribution detector 14 is 
connected to the distribution comparator 15. The distri- 
bution comparator 1 5 Is connected to the characteristic- ao 
value detector 1 6. The characteristic-value detector 1 6 
is connected to the converter 17. The CPU 12 is con- 
nected to the interval deciding device 13. The interval 
deciding device 13 is connected to the difference-value 
detector 11. 45 
[0079] The apparatus in Fig. 12 receives water- 
mark-embedded data (watermarked data) generated by 
the apparatus in Fig. 8. Specifically, the watermark- 
embedded data are inputted into the difference-value 
detector 1 1 . The watermark-embedded data are formed so 
by a sequence of samples. 

[0080] According to a first example, the difference- 
value detector 1 1 calculates the values of the differ- 
ences between samples of the watermark-embedded 
data which are separated at a predetermined interval. 55 
[0081 ] According to a second example, the CPU 1 2 
gives a desired interval to the interval deciding device 
13. The interval deciding device 13 decides, on the 



basis of the desired interval, an interval related to calcu- 
lation by the difference-value detector 11. The interval 
deciding device 13 informs the difference-value detector 
1 1 of the decided Interval. The difference-value detector 
11 calculates the values of the differences between 
samples of the watermark-embedded data which are 
separated at an interval equal to the decided interval. 
[0082] According to a third example, the difference- 
value detector 1 1 calculates the values of the differ- 
ences between samples of the watermark-embedded 
data which are separated at an interval varied on the 
basis of a random-number table. The random-number 
table is possessed in common by the encoding side and 
the decoding side. In this case, it is possible to provide 
a high security for watermark information. It is neces- 
sary to match the phase of the decoding side with the 
phase of the encoding side. Accordingly, the data 
processing scheme is designed so that a unique pattern 
will appear in difference values when phase matching is 
established. 

[0083] A fourth example is designed to provide 
good resistance to data processing for picture rotation. 
The fourth example considers the fact that a vector 
between successive samples varies. According to the 
fourth example, the difference-value detector 1 1 varies 
a vector value, and simultaneously calculates the val- 
ues of the differences between samples of the water- 
mark-embedded data while using a vector, with which 
the previously-mentioned unique pattern appears most 
noticeably, as a reference. 

[0084] According to a fifth example, the difference- 
value detector 1 1 calculates the values of the differ- 
ences between samples of the watermark-embedded 
data which are separated at an interval changed in units 
of given sample number or given time. 
[0085] The difference-value detector 1 1 informs the 
distribution detector 14 of the calculated inter-sample 
difference values. 

[0086] The distribution detector 1 4 handles the cal- 
culated inter-sample difference values for every group 
of 1 024 samples. The distribution detector 1 4 calculates 
a normalized occurrence-frequency distribution of the 
inter-sample difference values. The distribution detector 
14 informs the distribution comparator 15 of the calcu- 
lated occurrence-frequency distribution. 
[0087] The distribution comparator 15 compares 
the calculated occurrence-frequency distribution with a 
general Laplace distribution given by the previously- 
indicated equation (1). Specifically, the distribution com- 
parator 15 derives the occurrence frequency of a differ- 
ence value "0" from the calculated occurrence- 
frequency distribution. Then, the distribution compara- 
tor 15 uses the derived occurrence frequency of the dif- 
ference value "0" and the previously-indicated equation 
(1), thereby producing the general Laplace distribution. . 
Subsequently, the distribution comparator 15 calculates 
the occurrence frequencies of respective difference val- 
ues from the general Laplace distribution in a limited 
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range which corresponds to the variable range of the 
level of the watermark information. In addition, the com- 
parator 15 calculates the occurrence frequencies of 
respective difference values from the calculated occur- 
rence-frequency distribution In the limited range. Then, 5 
the distribution comparator 15 compares the calculated 
occurrence frequencies based on the calculated occur- 
rence-frequency distribution with the corresponding cal- 
culated occurrence frequencies based on the general 
Laplace distribution, respectively. The distribution com- 10 
parator 15 informs the characteristic-value detector 16 
of the comparison results. 

[0088] The characteristic-value detector 1 6 decides 
whether or not each of the calculated occurrence fre- 
quencies based on the calculated occurrence frequency 15 
distribution is in a ± 28% range centered at the corre- 
sponding calculated occurrence frequency based on 
the general Laplace distribution. Thus, the characteris- 
tic-value detector 1 6 decides whether each of the calcu- 
lated occurrence frequencies based on the calculated 20 
occurrence frequency distribution is extremely greater 
than, extremely smaller than, or comparable with the 
corresponding calculated occurrence frequency based 
on the general Laplace distribution. The characteristic- 
value detector 16 detects the characteristic value (the 25 
forbidden difference value) in accordance with the 
results of the decision. 

[0089] The characteristic-value detector 16 Informs 
the converter 17 of the detected characteristic value. 
The converter 17 changes the detected characteristic 30 
value into a corresponding watermark-information level. 
The converter 17 generates watermark information in 
accordance with the watermark-information level. The 
converter 17 outputs the generated watermark informa- 
tion. 35 
[0090] It is possible to accurately recover (repro- 
duce) the watermark information from only a part of the 
watermark-embedded data. Even in the case where the 
watermark-embedded data are picture data and are 
processed to slightly rotate or distort a picture before 40 
the data are inputted into the apparatus of Fig. 12, the 
watermark information can be accurately recovered 
from the inputted data. 

Fifth Embodiment 45 

[0091 ] A filth embodiment of this invention is similar 
to the third embodiment thereof except for design 
changes mentioned hereinafter. In the fifth embodiment 
of this invention, original data do not contain samples so 
having values "+4" and M". Thus, regarding the original 
data, difference values "+4" and "-4" tend to occur at low 
frequencies. In a decoding side, difference values "±4" 
and '-4" might be erroneously detected as watermark- 
related difference values. To prevent such a problem, 55 
samples having values "+2" and "-2" are previously 
added to the original data as random noise. Thus, 
regarding the noise-added data, difference values "±4" 



and M" occur at substantially normal frequencies. 
Sixth Embodiment 

[0092] A sixth embodiment of this invention is simi- 
lar to the third embodiment thereof except for design 
changes mentioned hereinafter. In the sixth embodi- 
ment of this invention, original data are picture data hav- 
ing a sequence of 8-bit samples. The picture data are 
luminance data or color-difference data. Every sample 
of the picture data takes any none of values "0" to "255". 
[0093] In the case where watermark information 
has 3 bits, eight different levels (eight different logic 
states) of the watermark information are assigned to 
eight different values selected from among all possible 
levels of a picture-data sample as follows. The first level 
of the watermark information is assigned to a sample 
value '78*. The second level of the watermark informa- 
tion is assigned to a sample value "88V The third level 
of the watermark information is assigned to a sample 
value '98'. The fourth level of the watermark information 
is assigned to a sample value "1 18". The fifth level of the 
watermark information Is assigned to a sample value 
'128V The sixth level of the watermark Information is 
assigned to a sample value "138". The seventh level of 
the watermark information is assigned to a sample 
value "148". The eighth level of the watermark informa- 
tion is assigned to a sample value "158". 
[0094] According to this assignment, the watermark 
information is converted into a corresponding sample 
value referred to as a characteristic value or a forbidden 
value. The picture data are processed so that the values 
of samples will not take the forbidden value (the charac- 
teristic value). 

[0095] Fig. 1 3 shows an example of the occurrence- 
frequency distribution of sample values in the process- 
ing-resultant picture data. In Fig. 13, the sample value 
"128" is used as a characteristic value (a forbidden 
value) related to the watermark information. 

Seventh Embodiment 

[0096] A seventh embodiment of this invention is 
similar to the fourth embodiment thereof except for 
design changes mentioned hereinafter. In the seventh 
embodiment of this invention, 1024 successive samples 
of watermark-embedded data compose a window. Each 
time the sample of Interest is shifted from one to 
another, the window is slid by one sample. 
[0097] With reference to Fig. 14, an occurrence-fre- 
quency distribution over the window is calculated and a 
variation in the occurrence-frequency distribution is 
observed while the window is slid, for example, from the 
position "A" to the position "B". The occurrence fre- 
quency of a characteristic value related to watermark 
information drops to zero at a certain moment, and then 
increases as the window is slid. For next 1024 succes- 
sive samples, the occurrence frequency of the charac- 
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teristic value gradually decreases. Such a variation in 
the occurrence frequency of the characteristic value can 
be detected. Therefore, it is easy to detect the water- 
mark information even if the data starting position is 
unknown. 5 
[0098] In the case where the watermark-embedded 
data are picture data, watermark information can be 
detected from only a portion cut out from the water- 
mark-embedded data. With reference to Fig. 15, the 
cutout portion corresponds to a rectangular corner zone w 
"AA", an arbitrarily-positioned rectangular zone "BB", or 
a rectangular zone "CC inclined at an angle of 30 
degrees in a frame. 

Claims is 

1. A method of inserting watermark information into 
digital data, comprising the steps of: 

determining a specified data value in response 20 
to the watermark information; and 
changing a data-value occurrence-frequency 
distribution of a predetermined number of sam- 
ples of the digital data into a modified occur- 
rence-frequency distribution in which the 25 
specified data value occurs at a frequency 
extremely different from frequencies of occur- 
rence of data values other than the specified 
data value. 

30 

2. A method of inserting watermark information into 
digital data, comprising the steps of: 

calculating differences between samples of the 
digital data to generate difference data repre- 35 
senting the calculated differences; 
determining a specified difference data value in 
response to the watermark information; and 
changing a data-value occurrence-frequency 
distribution of a predetermined number of sam- 40 
pies of the difference data into a modified 
occurrence-frequency distribution in which the 
specified difference data value occurs at a fre- 
quency extremely different from frequencies of 
occurrence of difference data values other than 45 
the specified difference data value. 

3. A method of inserting watermark information into 
digital data, comprising the steps of: 

50 

calculating differences between samples of the 
digital data to generate difference data repre- 
senting the calculated differences; 
determining a specified difference data value in 
response to the watermark information; and 55 
changing a normalized data-value occurrence- 
frequency Laplace distribution of a predeter- 
mined number of samples of the difference 



data into a modified occurrence-frequency dis- 
tribution in which the specified difference data 
value occurs at a frequency extremely different 
from frequencies of occurrence of difference 
data values other than the specified difference 
data value. 

4. A method of extracting watermark information from 
digital data, comprising the steps of: 

detecting an occurrence-frequency distribution 
of data values in a predetermined number of 
samples of the digital data; 
detecting, from the detected occurrence-fre- 
quency distribution, a data value which occurs 
at a frequency extremely different from fre- 
quencies of occurrence of other data values; 
and 

reproducing the watermark information on the 
basis of the detected data value. 

5. A method of extracting watermark information from 
digital data, comprising the steps of: 

calculating differences between samples of the 
digital data to generate difference data repre- 
senting the calculated differences; 
detecting an occurrence-frequency distribution 
of difference data values in a predetermined 
number of samples of the difference data; 
detecting, from the detected occurrence-fre- 
quency distribution, a difference data value 
which occurs at a frequency extremely different 
from frequencies of occurrence of other differ- 
ence data values; and 

reproducing the watermark Information on the 
basis of the detected difference data value. 

6. A method of extracting watermark Information from 
digital data, comprising the steps of: 

calculating differences between samples of the 
digital data to generate difference data repre- 
senting the calculated differences; 
detecting a normalized occurrence-frequency 
Laplace distribution of difference data values in 
a predetermined number of samples of the dif- 
ference data; 

detecting, from the detected normalized occur- 
rence-frequency Laplace distribution, a differ- 
ence data value which occurs at a frequency 
extremely different from frequencies of occur- 
rence of other difference data values; and 
reproducing the watermark information on the 
basis of the detected difference data value. 

7. An apparatus for inserting watermark information 
into digital data, comprising: 
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means for determining a specified data value in 
response to the watermark information; and 
means for changing a data-value occurrence- 
frequency distribution of a predetermined 
number of samples of the digital data into a 5 
modified occurrence-frequency distribution in 
which the specified data value occurs at a fre- 
quency extremely different from frequencies of 
occurrence of data values other than the spec- 
ified data value, w 

8. An apparatus for inserting watermark information 
into digital data, comprising: 

means for calculating differences between is 
samples of the digital data to generate differ- 
ence data representing the calculated differ- 
ences; 

means for determining a specified difference 
data value in response to the watermark infor- 20 
mation; and 

means for changing a data-value occurrence- 
frequency distribution of a predetermined 
number of samples of the difference data into a 
modified occurrence-frequency distribution in 25 
which the specified difference data value 
occurs at a frequency extremely different from 
frequencies of occurrence of difference data 
values other than the specified difference data 
value. 30 

9. An apparatus for inserting watermark information 
into digital data, comprising: 

means for calculating differences between 35 
samples of the digital data to generate differ- 
ence data representing the calculated differ- 
ences; 

means for determining a specified difference 
data value in response to the watermark infor- 40 
mation; and 

means for changing a normalized data-value 
occurrence-frequency Laplace distribution of a 
. predetermined number of samples of the differ- 
ence data into a modified occurrence-fre- 45 
quency distribution In which the specified 
difference data value occurs at a frequency 
extremely different from frequencies of occur- 
rence of difference data values other than the 
specified difference data value. 50 

10. An apparatus for extracting watermark information 
from digital data, comprising: 

means for detecting an occurrence-frequency 55 
distribution of data values in a predetermined 
number of samples of the digital data; 
means for detecting, from the detected occur- 



rence-frequency distribution, a data value 
which occurs at a frequency extremely different 
from frequencies of occurrence of other data 
values; and 

means for reproducing the watermark informa- 
tion on the basis of the detected data value. 

11. An apparatus for extracting watermark information 
from digital data, comprising: . 

means for calculating differences between 
samples of the digital data to generate differ- 
ence data representing the calculated differ- 
ences; 

means for detecting an occurrence-frequency 
distribution of difference data values in a prede- 
termined number of samples of the difference 
data; 

means for detecting, from the detected occur- 
rence-frequency distribution, a difference data 
value which occurs at a frequency extremely 
different from frequencies of occurrence of 
other difference data values; and 
means for reproducing the watermark informa- 
tion on the basis of the detected difference data 
value. 

12. An apparatus for extracting watermark information 
from digital data, comprising: 

means for calculating differences between 
samples of the digital data to generate differ- 
ence data representing the calculated differ- 
ences; 

means for detecting a normalized occurrence- 
frequency Laplace distribution of difference 
data values in a predetermined number of sam- 
ples of the difference data; 
means for detecting, from the detected normal- 
ized occurrence-frequency Laplace distribu- 
tion, a difference data value which occurs at a 
frequency extremely different from frequencies 
of occurrence of other difference data values; 
and 

means for reproducing the watermark informa- 
tion on the basis of the detected difference data 
value. 

13. An apparatus for inserting watermark information 
into digital data, comprising: 

means for deriving differences between sam- 
ples of the digital data; 

means for selecting at least one from among 
. values, which differences between samples of 
the digital data can take, as a forbidden value in 
response to the watermark information; 
means for deciding whether or not the derived 
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differences are equal to the forbidden value; 
and 

means for changing logic states of samples of 
the digital data which relate to the derived dif- 
ferences decided to be equal to the forbidden 
value to convert the digital data into conver- 
sion-resultant data to Inhibit differences 
between samples of the conversion-resultant 
data from taking the forbidden value. 

14. An apparatus for extracting watermark information 
from digital data, comprising: 

means for deriving differences between sam- 
ples of the digital data; is 
means for detecting an occurrence-frequency 
distribution of values of the derived differences; 
means for comparing the detected occurrence- 
frequency distribution with a predetermined 
reference occurrence-frequency distribution to 20 
find a difference value whose detected occur- 
rence frequency is smaller than Preference 
occurrence frequency by more than a given 
percentage; and 

means for reproducing the watermark informa- 25 
tion on the basis of the found difference value. 
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